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(54) CAMERA CAUBRATION DEVICE AND METHOD, AND STORAGE MEDIUM 

(57)Abstract: 

PROBLEM TO BE SOLVED: To perform simple camera 
calibration in the stereo method. 

SOLUTION: The distortion parameter of each camera is 
estimated by an image that is picked up at least three 
viewpoints without any spatial position restraint by 
reference and detection cameras, and at the same time 
each projection conversion matrix for projecting each 
picked up image to a virtual plane is calculated. Then, 
the inner parameter of the reference camera is 
calculated based on the projection conversion matrix for 
each picked up image of the reference camera. Then, 
based on the inner parameter and each picked up image 
of the reference camera, the image of a plane position 
that has been picked up is estimated, and a projection 
matrix to the detection camera is calculated based on 
the parameter of the plane position and each picked up 
image of the detection camera. 
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l^::*-- '>;^xi^0^r-v y yu— i^3 V^|S*P^-«t?— >';a5 
mi)^ixfcW-m^^:tj ^ 7f^raW^i1ttBi*)S®Jiv^3« 

HulE^ 3 '7 y^icj: I? ^ti/fcHuES** ^ 7 o 
F*395/^7p<-^Sl>-mJfE52p;&7( 7(D#miii^5rS 
(r. ®^bfc¥ffleB^fil:£-rS^4cD^r5':/i:v 
BtrlH^ 4 <o;^ X s' -/iz. J; !9 Iftjg * *T.;'h¥ffiffig©/-?7 

-^xi>'HSisMm*^7(o#«^iii^^sic, ttiteittii 

;«;;^7--©e»tt^iJ^S(llf?.l|5roy^x-7 7'i. 
{i-rsr i:5r#mi-t5*^7 • ^-^ y >3 

[fS*il7] BMlHSJ¥*^7S.t>*HfIIS:^W*y 
7W«-2Ki±©tg^iii^^SfC, ¥®eS(0/'?7^- 
^J' , tuE^tW;*/ 7i 7'^©iS«=fT^JSrftMjktS^<7 ^ - 
iJ'ttiE;^ 7^ -7 ::^$rffix 5 r i t -t-Ssf 6 tia 

[|»*^8] mrlE^N'7;^-i?ttIE:^X77°tt. 
SufES*:* ^ 7 (OrtgB^^•7 -iS'^t^tulBSip* ^70 
BtfE^ 7 7 <t 9 tS^§nfc¥B^Sro/-?7 ^ 

-^Rxfmumm:h^y(D^mum^i:m{z^ mBmm 

* 7^(DS^^T?|J^»ttli-5ll 8 7^ t . 

¥B{Sig<75/-?7P<-^. MIE^ffi;*; 
^7--(OlS:«fTi?iJSr*®{t;t-5||9©;^X7 7'i:, 
x5ri:Sr#ma:1-5g«*«7lc|ElSro*p<7 • dr-v-y 

» ttli-5 r t «r#® t -tSfl^JS 6 IcIHlt©* y 7 • ^ 
y T'u— >3 i^;^jfe„ 

Ifl*«iO] S2p*^7tMtii;«7^7-C«fig$iLS^ 
TU:t- i^;^xAWdf--ir i^— i/3 :/s.gE^/<^— 

;as}Sd»*ifc^B ^ 7 T-^ra W:^effiBi«]^(75 ^.e V ^ 3 
£i±<0^g^T'li^LfcSi^^ffl^^T^t5*^ 7 • =ar-^ y 
'>3 V^oaSra vf=L— ^ • ->;^xA±-C|ltT-f 

\i°^~-'^-ssBM^X'^mmc^^Lt:.Bmmii^xh^ 
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SulEH 3 c7);^x 5/ :/t J; 19 ©tii $ nfctulES*;^? ;^ 7 w 
J^. a&Lfc^ffi^fi^^t^-r5^4cD;^7^s/7°<t. 10 

*^7--»g^^T?iJ^»l±i1-5>^5©^-rs'yt, 

miH^i 1] suE=':xf^-i? • yy V^^T\-t. $ 
mrlHS*;*y 7St;5j5|g;^tfl;i;^^<^^2ei±(0 

7 -^(DRSenm ^mmit-t ^y<y}i-^miE:^'ryy^ 
«x5rtSr#mt-t5 ft*« 1 0 {cfEiKcDfaiiiK*^o 

[tf*:®l 2] HulS/-'7^-i5'{^iE7,xs'7°«. 20 

MISSSg;* 7 rtlip/-« 7 ^ - 2itJf fltilESSp* ^ 7 <o 
7-5/ 7°i:, 

-^^t>'mltefiltB;*;^7C0=§-a^H^SrS{e:. mW^m 
:ti:^y^(D&mn^^i^Wm-r^m8(D^y^-y:rt^ 

^Wt^mm^mz.. ¥m^s.<^^<y^-^. m^mmiti 

^7--©gJ^ff?iJSrftii^k-f5^9©^X3'yi:, Sr« 30 

lo 0 0 il 

•f 7 p« - J? ^» W 1" 5 * 7 • ^ y y u- V- 3 v;^ 

W-tiii:no:iJ?^y-^^V^i—>3 >:bmRlfmm. 

[0 0 0 2] ZimL<i-i.. ^^mn. ;^xu:t?£<o* 40 

<D>fcVN-ftE©VffiSrffiv^T. m.mf\rmi^i£i-^ti:y<y / ~ 
^^niii-t?>tLJf>oy:f};^y-^^V:/i^-'>3:y:^WiR 

[0 0 0 3] 

i^'f''il>Ct3ft7c!^fraE(D^Mi:^^^jSi^ ( r^l 
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(D^i^X-h-oXt. :f};^y(0^m'P'bCi:iT&^<icoiv 

x:k^fmtLxi^Biti. mic^ ^m'¥-bct>hm^ 
[0 0 0 4] *fc, m^M^-iwmxh?>m^. -toE 

imnm^i:^xts^%mkti> ^ t xk^^mmmi^^ 

5i:v^5wi:f*. W^^m(r>W^j^m\^ii\'^Xlij:<^h 

raifeaisj m^mw.. 1990) {cut, 5c©piife^ 

^^M.imm^f\^x\,^i>, mm'Aa^M^^^iismn.. 

[0 0 0 5] ^mm.m^m-t^m.^%^mmmt. m 
hmm-r^^ti'^x^^o ^^X'mb^7-u:t^h\t. 

[00 0 6] *B^iffl**-e{4. mfim^-M.^.. 2-d<du 

^t^£i:>h2m<O^;^y<D?^^m\'^Xy^v-U:t&^ff0 
^ti-rs, lo(D*p«7f4aip*^7i: LTffiffl* 

^^mtl-r^o ft&:*-«);^7>7H^I±l*>7iL-C 

mti-r?>o 0 7(4. ti^¥®(->i^-r6«2p;{7y7i:Mtti 
*^7(^ia«^ms:e^(-*LTia'9> sfc. ii8(c«, 

B&iE*?^©/-?^ - >*S2P* ;^ 7 i ^ 7 

[00 0 7] 07 t,T^1-J; 5 SJP* 7<^g^iS^ 
t?»i, «^fejl*^i^i5¥ffi±«)^MtS2p*y7<o^i^ 

m^'bc. t^'^smma. mm:i}^7<Dnmx'h^o 

«IW*^7«S^fejiilfe-efi. ;^fMi:;^W*;>«7<^ 

:*y(r>1^§ef-t>C,k%:^Smmtt. ^ffi*^7<^tlll 
[0 0 0 8] y (ommt. Sltti;&;^70S»^ 
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[000 9] m 7RXJ^m 8 fr^i-^ajT-Ji. B&iE:^ 

m(Dm^m^±K\^i^m-rio lo 
[0 0 10] ±iELfc<};5(w. Wi^mm^¥mx'h?>m 

yCO^^m^'^oy^m' (xd, yd) (Dmiat, &.T(0 
^iimA-ri>c aU l5iIS:^'<^H«3 X 3lt:^^|j^?lJ 
Tfe5„ 
[0 0 1 ll 

m'=H«m 20 

[0 0 12] ^§em.Wff^mi-i. ;*;^7<^rt^lp/^•7>- 
m^tm!i&. 1 9 9 0) {'f±, mmmmtrnmrnm^i^ 

[0 0 131 aJi*;<7©m^fi> Mtti;*;><7 0*;^y 

y— ^-iT'fiaif/K— 7 . 30 

ipt>«** ;>« 7 t »!gilO::*c/hlci6) fe-f, Sit* ^ 9 
[0 0 14] @9{C«, • :^tll;i? 

[0 0 15] Ui±<©^f5I3fe^6<]tt«^?IJfflLT, 

[0 0 16] Lit^L^t^h. WL^M^i:m^htciEmm 50 
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(D!gil^t+aiJi-5 r t (i. ^ 7 ;4Sj$oa^3t^m;as 

[0 0 1 7] 7^5^o/N°7;^-^tt. ^yX©^;^;^ 
/ 7 w 3 jS:7c12:BS-^1-^g|5^-?7 ^ -i? § 

#S (-ssi^iiaa i o T L s 5 o 
[0 0 18] ^fc-is:fi<)?fc*^7'=¥-¥y:/u— >3 V 

^y<y/~'?^mm^'»m-r^:)j^xh^o mx.\-t. ro 

ger Y. TsaiS^(DfM5[''Aji Efficient and Accurate Came 
ra Calibration Technique for 3D Machine Vision " 
(1 9 8 6, IEEE) • =¥-Y 

Tsai(^);^^£4rll^T-rsfci6^::(t. ]Efit''i#fl§^>!i5fS 
[0 0 19] ^(n>i.of£f-^t^M-^m.m-^<. miS. 

[0020] ^Jxtf. Zhengyou Zhangl^<^^:S::'A Flex 
ible New Technique for Camera Calibration', Micros 
oft Research Technical Report, 1999 (http://www.re 
search, microsoft. com/"zhang/) \Z.\t.^ yWrtSB/''? 

y :^~f^W-^-t^^mc^\^^xUW.^fiX^^^t^. y- 
T- M-f- -5 ^-^ 7 ^ - 5ra^f 5 i- (41g o T 1/ ^ 7i 

[00 2 1] JeAiSrBSw-f-ixtf, ¥ffi±OK^/N-^?- V 
^^fii>i5^t^bi>:^yX^^-t^tz.\1^X\ ¥ffi»fia 

7 • ^ir y >3 i'SrlBi^fifi'^C^S^IISiSS^tv 
[0 0 2 2] 
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[0 0 2 3] **BjroMjS5S6tiH. ^BiofE^n/-?^ 

ffift-rsr tfcfcs. 10 

[0 0 2 41 

•iry:^^— >3 v^fT5:*>7 • ^-t y 7'^-->3 
V ^ 3 iU±©m^-em LfcSi^^^Sjt-r 5H^«Jt¥a 

[0 0 2 5] rrT% miia^-«7^-i5'^til^g:H:, #» 

(D^^t. BUlE^2©^g{r<tt9*«)fc^^fcB^if3S2p;* 
cOrtgi5/N'7^-^*^m-rS^3W^©t. HuiEM3© 

[0 0 2 6] miJ^fy • df^-r y >^i^-2^3i^iga 

[0 0 2 7] ^fc. HfrE^^•7P<-^<^^¥g:^4, =s-g^ 

OJH5IESip*;'7«a^Pi^^S{;i, Ji^L/t¥ffifee 
S:«^i-5m7C)^|&i:. HuKm 7 i ij «|^$ 

^^fc^Fffi^it:e©^■«7^-i5'&U^mIE^ttJ;^Jp' 7»#S^ 
5HfeSr«t-, t«rfB^lil*^7'^Ofti^miJSr^tii-t5^ 

mil2SltiJ*^7--©S»tT?iJ$:*ii^k-r5^9©^ 
Si:, -e«^-t-5rt;iST-tS„ 50 
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[0 0 2 8] #a^®^*g(fs®^^B^t-a-fc 

•tiriitfri: (Image Registration) fiioTS^^'^y;'' 

[0 0 2 9] s/c, ^wn(^m2(7>mm\t. mmij^y 

Sr«VTtT5*;^7 • =^-Y y >3 >-:*r>£T'$)o 

«-S^®I^Srffiv^TmFlES2p*^7&T:;mrE^tti* 
^7©s;^/-?7;<-^S:f6^-r5^l©;^X5'7't, # 

Stti-r^.B2(;>;^7^->7'i. WIEI|2©x^7"5/7'Jc:J;!9 
*«> e)ti-fcBirlESip* ^ 7 ©€-«^H^few W»^t&tT?iJ 
SrK (ctiilESP;^ p« 7(^rtlFP/<7 ?( ^rgHi-tS^ 3 
i[ism3©;^7'-;/7°(cJ; t9Sm$^xfc|fr 
IB*** ^ 7 ©rt^^<7 y - ^'STJ'milES^P* ;^ 7 ®# 
miiii^^Sfw. a^Lfc^ffi&B$r*iSi-5B4(Dy^ 
7^s/:^i. S(ffBB4(7);=^X2/7°{c:J;"9jtS$^fc¥S^ 
gO/-?7P<-:^'St/HulH:^m:&p« 7©^a^®^Sr« 

Binetfelli*y7--(0SjKtT5?iJSr^tili-5m5ro;^x 
y:ft. i:Sr#mt-f-5*y 7 • +-^y 7" 

[0 0 3 0] ^*;<7 • =^-^y7'U-:>'3>':;^fef4, M 

lESipi; ;^ yRXIm^^m^ ^ 7 CD# 2 &.±.(D^^M 
^m^. ¥®*iS(^^<7^-^, ltilB^tW*^7'-(^S: 

[0 0 3 1] *fc, HfilE^-?7;''-^<gIE;^x->7°f4. # 

¥Bett5rit^-r5B7(7);=!;7=-->;^t. huIE^7(^;^x 
tb*;^7«#^ifeW^SrSfJ:. SiFlB^glW*^ 7--oSj^ 
5pS^2:«©^-«7;'-i5'. WIE^ttl*;<7'--©Sj^ff?iJS- 

So 

[0 0 3 2] Sfc, *^0^<^)||3cD{ilffil4. S2P*y7 

i^til*p<7T-«^$ti5;^7"i^;t • ->;^7"A(^:J(r-v y 
Srffiv^TfT5*;'7 • =^r+y ->3:/«iSSr3^'t° 
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[0 0 3 3] *^?^«m3(0«aic-ff.5IEttl«ft(j:. m 

iK<^T'fc-3o rcOi ^Jtei^^^tt, ^J;t«. CD (Compac 
t Disc) -^FD (Floppy Disc) , MO (Magneto-Optic 

al disc) i^£i:*C0«fiSl£T'Rragtt<Di5'ltii^*:T'fc5, 20 

KS'JSrFp^i^'iV^) fi:}f(D^^mmmiih^i:m^ LT=J>'f 

pj®BiXt>*B2(75#{i)B(-#5;&p< 7 • ^^^y u- 

'So 

[0 0 3 5] 

[0 0 3 6] *^?^(;i#.5;&p<7 • ^-y yyu— >3>' 
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[0 0 3 7] •r^'itJ*,. ¥ffi±co|{jai/^^-ySrM>i'5 

[0 0 3 8] Sfc. ^•«^-^im*PT'&5j£i>S(4fe5;iS 
V— -if • y y >-^'^T'/-?^->^|±i;^i Lfciffiilrffi^ 
[0 0 3 9] ^fc. a^cD^H^-^if-XDJSii^ixit (lA 

[0 0 4 0] *^0Jc75$t,{c:ftkcoBW. 4$®^^iJ,^tt. 
» 'tmsj I- J; o -c K b 5 Tfe ^ 5 o 

[0 04 1] 

[0 0 4 21 iitTT'(4. ili^±cD,^>^. 
[0 0 4 3] 

m = [M,vf 

[0 0 4 4] tu Sfc. ?gF^ctJ(7);j^Sr 

[0 0 4 5] 

M = [x,y,zf 

[0 0 4 6] tb, #;^<75afiSfeffi«mT'£DfE5ieSr^n-e 

[0 0 4 7] 
[iC4] 

m=[M,v,lf 



[0 0 4 8] :i©J:p7icS^, ^F^fcD.^.Mtiii^±(0 
[0 0 4 9] 

m5] 
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[0 0 5 0] c:r:T\ s «;^<>--yi'ia^T'$)?)> tr^iJ 
CR, t] «^g|5^<7^-^tiqi»ftl5t»T\ 

[0 0 5 1] 
[ic6l 

a Y kO' 

A= 0 iff vO (2) 

0 0 1 



[0 0 5 2]rr-c\ (uo, V 0) «ii^^^';i:,^Sr* 

L. a (=- f • k u) , ^ (=- f • k v/s i n 

(=f-ku-cot9){4 2 ocol^fCfc C^xSrSi". 20 
tfc, =ff?ijP=A- [R, t] {4. ^relrtcD^Sriii^ffl 

3X4 «S»tT?iJ<!:1-.5o 
[0 0 5 3] eJl±(©iHxE-C-fi, i^vXS^z^^lc iSj^fPSr 

©ti-5o ^^JSS©^md= [ud, vd] 'i,^.m = 
[u. v] '®||«{4. aT{c^i-iC-r'at-;ii::45-c# 

[0 0 541 30 
IiC7] 

tt = arf + (ift/ - cm) • *: ■ r^/^ 

V = V</ + (v</-CV)-jK'T</* (3) 

[00 5 5]{tL, r d'= (u d-c u) '+ (v d- 
c v) * s v'ffofj. (cu, c v) n.'^Vi.^-h^^ s 

[0 0 5 6] ^U^T. Xxl/;tffilC*i}t5SggltfSiJ:fe-& 
^co^^T|ji0^1-^.. m 9 {r^-r J: 5 «2P*>7, ^ 
tbl;*;>«7'>.©S]^fT?iJSr-€-HmP. P' t U S2PSi 40 

U ■?:i^^'^^®^i^^±<7^^tt, 5C (3) S:ffiv>Tt>-f;^^ 

[0 0 5 7] MMt.-(i<r>^mm\-^-f^^^. S^Pil^ 

[0 0 5 8] 3:f3K-7 • ^f^tt^y 7'?''il>i:AmS: 50 



[0 0 5 9] j^:^^T^ 7-h<7?^m'^Sj^$tLS 
ov>TiiiBJ-r5» ^m^asti^±©^«. (1) Sr 

[0 0 6 0] 
[^8] 

M = jP*m+p^ (4) 

[0 0 6 1] rrT-p*«pro|g{HiMtT^J-efot), jiS:* 

[0 0 6 2] 
[fc9l 

P*=pr(ppr)-J 

[0 0 6 3] *fc. \m.'^^mfz.-t-<^ ViVhfi: 

-To {IL. a)f4ffiSc©4JJ:5c'<^ hyv-cfcSo 
[0 0 6 4] 
m\ 0] 



P^=(I-P*P)«> 



(6) 



[0 0 6 5] (4) tt, %^^-h-BiX^W!m'$kiL(r>^. 

mSriiS1--<Tro,'5;^«LTV^•5;6^ SgBf^Zi t-f?, 
[0 0 6 6] ti±(Dri:;6^P,. ^mP^O^<D^m^*l^ 

t. A' . R' , t' ^^n^tim^\ci^^?>i)\ X 

^' K 1 , cul, cvl, svl k2. 
cu2, cv2, s V 2?rg[(±!i-tl«<tV^r <t»C/£5„ 
[0 0 6 7] iilT> llBSr#ffiL/.c;d5P>*^MO|lffiro 

[0 0 6 8] 01 :^%m<r>mm^m^n.?>:ij y 
• y >3 v^a 1 0 (Dm^^msm^m^mcTjp 

[0 0 6 9] SJP*^7 iXU'^;±i;i7>7 2(;:j;t). iE 



(8) 
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[0 0 7 01 y<^M-ifW-m^5X'li. S*.5^i;ST'ii 

[0 0 7 1] y<y^-'^^lE^6X(t. 

HiSfcS) , ^iELfc^<y^-t??:/<7^-^'^«ftaJ7 
[0 0 7 2] m2liai. v^°7;^-^5'a^ttia5 5^C^J^^T|| 

[00 7 3] *-f. mf£^3mjkX'y<^-:y(DmA>th± 
^miWt^-t?> (;^xs'ys i~s 3) , rr-c, sap 

[0 0 7 4] mm<^m. w-m<o^m6^tmm mtu 

^) icmLxix n>^mcw-fTX'mmm.\,\ ^fc, 
u^-r?)^<^~iy[^-o\/^x-hm^mmi-it£\^^i)K kxtx 

[0 0 7 5] (1) ^^^<^}i-^<Dm/^ (y.y^'vzfS 

l&U:mtil*^7 2©#Ji^H^feSrffiV^T. 30 

[0 0 7 6] ir-ei-5-^^H#i:t4. XYZmm^iC 

^3v^T. x-Y¥aof^:^^TT*J.oz=o<D^^g^ciBfi$* 
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$nTv^5#^¥l 1-16 12 1 7-^?gipa#{::H^§ 

[0 0 7 7] -g-^S&±(0,^Srm.= [X., Yo] \ » 
^Bi^±©-^^md= [ud. vd] \ 2;^y^^^*Lfc 
m^±o:>^i:m= [u. v] 't-fSt. #-^C(^H«fi 

El 3 ic^-Ti 5 MmwiWn^m. tm^y^y?^-^ 

{k. cu. cv. sv) \z.i:iom-t:iti)^X-^?,a o 
»^li^±©^ma ^S; (3) *fflV^Tm--^t& 

[0 0 7 8] 
[icll] 

mo = Ho>m (7) 



[0 0 7 9] ±S:{r^■rSI#,{:lS-^v^T, H4{c^-rj; 

it^LfcB^S-|^-(^-^fifeH^^^:>*ji^ (Imag 
e Registration) ^tT^=e5^i:T\ /"^^ — ^Ji:^^^T 
5ri;SST-t5o m^-ri>y<y;^~-$'{i. m. 

^^<y;<—? (4^<y?i~^) ,b. #lilfepii^ I . ?, 

L. i = l, 2, 3 (IM^tJc^^^-ro roMSif^lJ; 

[0 0 8 0] 
mi 2] 



(8) 



[0 0 8 1] :i©fff«MC)*/Ht;tcMLT»±. ^^iHJ^Pp! 
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